An open-source LLM framework that turbocharges AI app development with enterprise-grade security and scalability, making complexity a thing of the past.

Unified API for managing LLM requests across providers.

Build efficient general-purpose AI models with smaller memory footprint and faster inference.

Create AI-friendly llms.txt files for your website.

Open-source AI models for fine-tuning and deployment.

Open Source LLM Engineering Platform for debugging and improving LLM applications.

Free tool for creating AI-optimized website content files.

TypeScript MCP framework for building applications.

A unified workspace for running multiple local AI models with privacy-first design and OpenAI-compatible API.

Monitor, evaluate, and optimize your LLM-powered applications

Automate your LLM application evaluation loop

Calculate GPU memory for self-hosted LLM inference.